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Abstract. - We propose a piecewise deterministic Markovian jump process in Hilbert space such 
that the covariance matrix of this stochastic process solves the thermodynamic quantum master 
equation. The proposed stochastic process is particularly simple because the normalization of 
the vectors in Hilbert space is preserved only on average. As a consequence of the nonlinearity 
of the thermodynamic master equation, the construction of stochastic trajectories involves the 
density matrix as a running ensemble average. We identify a principle of detailed balance and a 
fluctuation-dissipation relation for our Markovian jump process. 



Introduction. — Dissipative quantum systems are 
often described in terms of quantum master equations, 
where linear master equations of the Lindblad form are 
most popular in the literature [TH3]. However, it has been 
known for some 30 years that these linear master equa- 
tions have a fundamental problem because they invoke an 
inappropriate "quantum regression hypothesis" [4]-[6] . For 
quantum systems in contact with a heat bath, this prob- 
lem has been overcome by the projection-operator deriva- 
' tion of a nonlinear quantum master equation associated 
I with a "modified quantum regression hypothesis" j3] . For 
I more general thermodynamic environments, a generalized 
1 nonlinear quantum master equation has been obtained by 
a most natural extension of the geometric formulation of 
nonequilibrium thermodynamics from classical to quan- 
tum systems [3{5] inspired by Dirac's method of classical 
analogy [10]. 

The present letter addresses a possible route to the 
numerical solution of nonlinear thermodynamic quantum 
master equations. Stochastic simulation techniques have 
been established as a particulary versatile and convenient 
tool for solving quantum master equations p1lll| . The ba- 
sic idea is the unraveling of the master equation (see, for 
example, chap. 6 of [1]). The time-dependent density ma- 
trix or statistical operator p[t) solving the master equation 
is obtained as a second moment or expectation, 

p(i)=E(|^(i))(V(i)l), (1) 

where ip^t) is a suitably defined stochastic process in the 



underlying Hilbert space. Such a process consists of ran- 
dom quantum jumps and a deterministic Schrodinger-type 
evolution modified by a friction term. 

We begin with a brief summary of the general form 
of nonlinear quantum master equations based on ther- 
modynamic principles. After introducing a general class 
of piecewise deterministic Markovian jump processes in 
the underlying Hilbert space, we identify the parameters 
required to reproduce a thermodynamic master equation 
and wc discuss the form and significance of the jump oper- 
ator in detail. In the conclusions, we discuss the usefulness 
of the Markovian jump process both for stochastic simula- 
tions and for gaining fundamental insights into dissipative 
quantum systems. 

Thermodynamic quantum master equation. — 

Based on purely thermodynamic considerations and a 
generalization from classical to quantum systems inspired 
by a geometric formulation of nonequilibrium thermody- 
namics, the following master equation for the evolution of 
the density matrix p on a suitable Hilbert space has been 
proposed to characterize a quantum subsystem in contact 
with an arbitrary classical nonequilibrium system acting 
as its environment |7H9j: 



dp 



'-[p,H]-l-[H,,S,r^[Q,[Q,HU 



^Q\ 



[H^.H^f^lQ^lQ^p]]. 



(2) 
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In this equation, h and fee are Planek's eonstant (divided 
by 27r) and Boltzmann's constant, respectively. The first 
term describes the reversible contribution to the evolution 
generated by the Haniiltonian H via the commutator [ , ] . 
The remaining terms are of irreversible nature and result 
from a coupling of the quantum subsystem to its classical 
environment. They are expressed through double com- 
mutators involving the self-adjoint coupling operator Q so 
that the normalization condition, ti p = 1 , is automati- 
cally preserved in time. The subscript p on an arbitrary 
operator A indicates the modified operator 



Ap = 



^Ap^-^dX, 



(3) 



which is basically the product of A and p, but with a 
compromise between placing p to the left or the right of 
A. If A is self-adjoint, this property is inherited by Ap. 
We further have the useful identity 



[^p,lnp] = [A,p], 



(4) 



which can be established by evaluating the matrix ele- 
ments for the eigenstates of p [7j . 

Whereas the type of the coupling to the environment is 
given by the observable Q, the strength of the coupling is 
expressed in terms of a dissipative bracket [ , ] defined as 
a binary operation on the space of observables for the clas- 
sical environment (in this letter, boldface bracket symbols 
are used to distinguish classical dissipative brackets from 
quantum commutators). If the equilibrium or nonequilib- 
rium states of the environment are characterized by state 
variables x, classical observables are functions or function- 
als of X, and their evaluation at a particular point of the 
state space is indicated by a subscript x. The classical 
observables H^ and Sc in eq. ([2]) are the energy and the 
entropy of the environment, respectively. For arbitrary en- 
vironmental variables Ac and B^, the dissipative bracket 
occurring in the master equation ^ is of the general form 



[^cSe]^ 



dAix)^^Q^^^dB^^ (5) 



dx 



dx 



where M^ is a positive-semidefinite symmetric matrix. 
The size of the square matrix Mo is given by the num- 
ber of state variables x. 

As a straightforward generalization of eq. ([2|), several 
coupling operators Qj can be incorporated easily [4l[7l[8]. 
The proposed construction of an underlying stochastic 
process can be generalized accordingly. The master equa- 
tion ([2]) describes the influence of a classical environment 
on a quantum subsystem. The equation describing the re- 
verse influence of the quantum system on its environment 
has been given in [THS]. 

Stochastic process. — In order to achieve a represen- 
tation ([l} for the solution of the quantum master equation 
([2]), we consider a piecewise deterministic Markovian jump 



process in the underlying Hilbert space. The construc- 
tion described here is inspired by the work of Breuer and 
Petruccione [l][T5l[T6], with the pioneering precursor pa- 
pers |17[|18) . however, we do not insist on preserving the 
normalization of the wave function for each realization of 
a stochastic trajectory. For nonlinear master equations, it 
is perfectly natural to think in terms of mean field interac- 
tions and to preserve certain properties only on average. 

Definition of Markovian jump process. A key step in 
the construction of the underlying stochastic process is the 
introduction of the jump operator, which we assume to be 
of the general form 



Q^a{Q + P[Q,H]pp-^), 



(6) 



where the real coefficients a and j3 remain to be deter- 
mined. Note that, contrary to the coupling operator Q, 
the jump operator Q is not self-adjoint. Once we have 
defined the jump operator Q, we only need to specify the 
jump rate and the deterministic evolution between jumps 
to obtain a complete definition of our piecewise determin- 
istic Markovian jump process in Hilbert space. We per- 
form quantum jumps 



V' — ;■ QV' with rate 7, 



(7) 



where the rate parameter 7 remains to be determined. 
Note that the wave function Qil) is not normalized. Fi- 
nally, we propose the following modified Schrodinger equa- 
tion for the deterministic evolution of the state ip between 
the random jumps, 



'i-ln,... 



(8) 



where, contrary to the Hamiltonian iJ, the linear operator 
A need not be self-adjoint. Again, the normalization of the 
wave function ij: is not preserved. Whereas the jumps in 
eq. d?]) correspond to the noise represented by the diffusion 
term in a classical Fokker-Planck equation, the modifica- 
tion of the Schrodinger equation by the linear operator 
A in eq. ([S]) is the counterpart of deterministic friction. 
The striking simplicity of the proposed stochastic process 
defined by eqs. ([B])-® should be noted. 

Master equation for second moments. In order to 
identify the proper choice of the parameters a, /3, 7 and of 
the friction operator A we write the evolution equation for 
the second moments which, in the spirit of the unraveling 
idea expressed in eq. ([TJ , can be regarded as an evolution 
equation for the density matrix. 



dp 
'dt 



-[p,H]+Ap + pA^+j{QpQ^-p), 



(9) 



where the jumps with rate 7 lead to a loss of the current 
configuration and the creation of new states distorted by 
means of the jump operator Q. After inserting the defini- 
tion ([5]) of Q, eq. © can be rewritten as 

^ = ^[p,H]~^a'(3[Q,[Q,H]p]-^^a^Q,[Q,p]], (10) 
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provided that the hnear operator A is chosen as 



A^l 



l-a^Q^ + a^l3^{[Q,H]pp-^y 



(11) 



The occurrence of the desired dissipative terms in eq. (|T0|) 
justifies the selection of the jump operator Q according 
to eq. ^. It is this jump operator that expresses the 
thermodynamic nature of the nonhnear quantum master 
equation on the level of the stochastic process. 

Note that both the jump operator Q in eq. ^ and the 
friction operator A in eq. (|11|) are expressed in terms of Q 
and [Q, H]pp^^. The implied relationship between Q and 
A may be regarded as a fluctuation- dissipation relation. 

We can now compare eqs. 1^ and ([TU|) to determine the 
remaining coefficients. We find 



and 



7a 



13 



2[Hc,Hc]^, 



[HcS^l 



(12) 



(13) 



Whereas /3 can be identified uniquely, only the combina- 
tion ja^ is fixed by the comparison, not the parameters a 
and 7 separately. This is a direct consequence of a scaling 
property of the thermodynamic master equation ([2]): any 
rescaling of the coupling operator Q can be compensated 
by a corresponding rescaling of the dissipative bracket so 
that Q does not have an absolute meaning. From eqs. (jH]) 
and ([7]) one realizes that the normalization of Qip is pro- 
portional to a. We can hence choose a such that the 
normalization of the state vector ip does not change on 
average during a jump process, that is. 



tr(OpQt) ^ 1^ 



(14) 



thus obtaining an absolute meaning of the jump operator 
Q (and of the coupling operator Q). Then, the normal- 
ization of the state vector ■0 does not change on average 
during the deterministic evolution either, that is. 



tr(Ap) - 0, 



(15) 



because a master equation of the form (ITUl) preserves the 
trace of p and hence, according to eq. ([U, the average 
normalization of '0- Indeed, both conditions (fT4|) and (fTS]) 
are equivalent to 



tr{QpQ) - f3hr{[Q, H]pp-^[Q, H]p) 



1. 



(16) 



Note that the sign of a is still not fixed by eq. p6)) . Ac- 
tually, one could even introduce a random phase in any 
jump without any effect on the resulting quantum master 
equation. 

Whereas, from a theoretical point of view, eq. (1161) pro- 
vides a most satisfactory condition for determining a, for 
practical purposes like computer simulations it may be 
more convenient to work with an approximate value of a 
and to fix 7 accordingly to fulfill eq. ([T^ . For example, 
one could choose the equilibrium value of a or the solution 
of the approximate equation a^tT^QpQ) — 1. 



Jump operator at equilibrium. As the jump operator 
Q is the key ingredient to our construction of a piecewise 
deterministic Markovian jump process, we next consider 
it in more detail for an equilibrated quantum system, that 
is, for [iH] 

p ex exp j - -^ I and T, [H,, 5e]^ = [H,, H,]'^. 

(17) 
By means of eq. Q, we obtain the following simplified 
expression for Q, 



1— ■ ^,-1^ _ o^ ^^ , „r^„-l^ 



Q = a[Q--[QpMp\p-^] =-iQ + pQp-'), (18) 
together with 



A = 



1 - ^(3q2 _ pqV' + QpQp-' + pQp-^Q) 



(19) 

By evaluating the matrix elements of Q for the eigen- 
states \n) of the Hamiltonian with eigenvalues £"„, 



(HQ|n) = f (l + expj:^!^ 



(m|Q|n), (20) 



we obtain an illuminating interpretation of the jump op- 
erator Q: The coupling operator Q describes the possible 
jumps between quantum states and the modified operator 
Q introduces the proper transition probabilities by a gen- 
eralized form of detailed balance for matrix elements rather 
than transition probabilities. This situation is very simi- 
lar to the well-known procedure in classical Monte Carlo 
simulations where one first defines the allowed moves and 
then introduces transition probabilities according to the 
Metropolis method in order to satisfy detailed balance 
(see, for example, p. 12 of [19] or p. 337 of [l4]). 

Harmonic oscillator at equilibrium. For example, for 
the one-dimensional damped harmonic oscillator with fre- 
quency w, the coupling operator Q coincides with the po- 
sition operator [5] and hence describes jumps into one of 
the two neighboring energy states. The energy differences 
En — Em in eq. ((20|) are given by ±hiu and the equilib- 
rium detailed balance factors favor jumps into the lower 
energy states over jumps into higher energy states. How- 
ever, these jump rates are completely different from those 
of the Pauli master equation for the populations of the 
energy levels (see, for example, sec. 3.4.6.1 of [1]) because 
also the deterministic influence of A in eq. ([8]) causes tran- 
sitions between the energy eigenstates. 

Summary and conclusions. We have introduced 
a piecewise deterministic Markovian jump process in 
Hilbert space with the jumps Q and the deterministic 
evolution ([8]). In these equations, the jump operator Q is 
defined in eq. (j6|) and the modification of the Schrodinger 
equation with Hamiltonian H is given by the operator A 
in eq. (jlll) . The remaining free parameters a, j3, and 7 
are defined in eqs. ([T2l) . (fT3|) . and (fT6|) . where actually 
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only /3 and the combination ^o? are physically relevant. 
For a proper choice of a, the normalization of the state 
vector is assumed to be preserved on average, both for the 
deterministic evolution and for the jumps. 

The thermodynamic origin of our Markovian jump pro- 
cess is reflected in the specific form © of the jump oper- 
ator Q. We have realized that, by construction, the jump 
operator Q incorporates a generalized principle of detailed 
balance. The jump operator Q and the friction operator 
A are connected by a fluctuation-dissipation relation. 

The evolution of the second moments of the Markovian 
jump process is governed by the nonlinear thermodynamic 
quantum master equation ([2]). The proposed stochastic 
process hence provides an unraveling of the thermody- 
namic master equation. Such a stochastic description of 
dissipative quantum systems in contact with a classical 
environment is very useful, both for developing stochas- 
tic simulation techniques and for gaining fundamental in- 
sights. 

As a consequence of the nonlinear nature of the ther- 
modynamic quantum master equation, the simulation 
of stochastic trajectories in Hilbert space according to 
eqs. d?]) and ^ requires knowledge of the evolving density 
matrix, that is, the second moment ([!]) of the stochastic 
process. This moment can be obtained as a running en- 
semble average. This fundamental difference compared to 
linear quantum master equations does not cause any severe 
problems, as is well-known from the theory of nonlinear 
Fokker-Planck equations, which are also known as nonlin- 
ear diffusions, processes with mean-field interactions, or 
weakly interacting stochastic processes (see [50], sec. 3.3.4 
of [H], or sees. 3.7.2-3.7.4 of [T]). In every time step, a 
single ensemble average needs to be evaluated in order to 
propagate all stochastic trajectories of the ensemble. Oth- 
erwise, the background and benefits of stochastic simula- 
tions are identical to the ones employed with impressive 
success for linear quantum master equations (see, for ex- 
ample, sees. 6.3 and 6.4 on photodetection and sec. 7.3 
on the damped harmonic oscillator and driven two-level 
systems in the textbook [1]). 

From a fundamental point of view, the stochastic re- 
formulation might lead to a deeper understanding of the 
evolution of dissipative quantum systems by offering a dif- 
ferent perspective. In particular, the reformulation might 
offer a possibility to build a theory of two- and multi-time 
correlations. This would, of course, require that among 
the many possible unravelings of the nonlinear thermody- 
namic master equation there exists a physically preferable 
one. It has been shown in [TSlfTB] that "the synthesis of the 
continuous Schrodinger-type evolution and the discontin- 
uous quantum jumps of the Bohr picture" arises naturally 
and directly in the description of open quantum systems, 
without any reference to the quantum master equation. A 
direct thermodynamic formulation of the piecewise deter- 
ministic Markovian jump process in Hilbert space might 
help in identifying a unique physically convincing stochas- 
tic process associated with a thermodynamic quantum 



master equation. 



I wish to thank Francesco Petruccione for encouraging 
me to look deeper into the properties of thermodynamic 
quantum master equations. 
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